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Common Feature: Intractable (NP-hard / NP-complete) problems! 
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QuAIL: Quantum Artificial Intelligence Laboratory 


Brief Development Timeline 

2000—2011: Occasional NASA research on quantum computing, including 
seminal papers on adiabatic quantum computing & quantum annealing 

Jan 2012: NASA organizes the First Quantum Future Technologies 
Conference attracting eminent researchers worldwide and participation 
from companies such as Google and D-Wave Systems [ 

Nov 2012: NASA signs innovative 3-way Non-Reimbursable Space Act 7 a Te 
Agreement (NRSAA) with Google and USRA re 

Jan 2013: Site preparations begin at NASA Ames using Center 
investment funds for installation of D-Wave quantum annealer 

Sept 2013: 512-qubit D-Wave 2 system comes on-line at Ames 

June 2014: AFRL funding for research in quantum annealing 

Aug 2014: IARPA funding for MIT-LL led QEO collaboration 
among NASA, TAMU, ETH-Z, UC Berkeley, and MIT 

July 2015: Upgraded D-Wave 2X quantum annealer comes on-line 
with over 1000 qubits 

Feb 2017: NASA signs NRSAA with Rigetti Computing for collaborative 
work on their prototype universal quantum processor 

April 2017: Latest upgrade underway for D-Wave system with over 2000 qubits 

May 2017: NASA to lead T&E effort for IARPA QEO program 


QuAIL team has published 40+ papers since 2012 
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NASA QuAIL Team Focus 


Long Term Ongoing Efforts 
¢ Determine the breadth and range’ « Initial target: Quantum Annealing 
of quantum computing applications - Only significant quantum hardware 


available are quantum annealers 
from D-Wave Systems 
— Currently the most prominent 


¢ Explore potential quantum 
algorithms and applications of 
relevance to NASA oe 
quantum heuristic 


: Evaluate, influence, and utilize — Widely applicable to optimization 
emerging quantum hardware problems, and sampling for ML 
- Bere OD programing pe ee — Early hardware used to develop 
COUN SNEMICN 2 MeN OgIeS, GUE. intuitions and identify potential 
— Characterize the hardware 
¢ Near-term target: Emerging 


capabilities, noise, etc. ; Geass 
— Evaluate and implement the most ae cobs se eadieates 
— Small universal quantum systems 


promising NASA applications 
ae — Advanced quantum annealers 
¢ Projections based on fundamental 
— Alternative approaches to 


understanding of quantum physics optimization, sampling for ML, etc. 
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Foundational Theory of Quantum Annealing 


Simulated Annealing | Quantum Annealing 
(Kirkpatrick et al., 1983) (Finnila et al., 1994, Kadawaki & Nishimori, 1998, Farhi et.al., 2001) 


¢ Algorithm: Start with large 
amplitude A(T) responsible for 
quantum fluctuations; then, 
gradually turn it off while 
turning on the cost function of 
interest B(T) 
Transitions between states 


¢ Algorithm: Start with high temperature; 
then, gradually reduce intensity of thermal 
fluctuations to obtain optimal configuration 

¢ Transitions between states via jumping 
over barriers due to thermal fluctuations 


E({z}): Free energy 


E({z}) surface (cost function) via tunneling through barriers 
| {z}=configurations in > of 08 On due to quantum fluctuations 
hh\ solution space Time, T 


E({z}) ® © © 

© E({z}, T=0) E({z}, t<1) E({z}, T=1) 

= ——w 
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= ~~ tunneling 

2 ——> {z} ee (Z} — {2} 
Initialize in an Quantum states Final state a bit 
easy to prepare explored by string encoding 

full quantum quantum the solution 
Time) superposition tunneling with probability 
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Tailored problems to 
show quantum RA 


enhancement ze MMING 
& 


Device calibration : 
techniques Study of annealin 
Hidden bottlenecks of in 1D chains 
large-scale problems 
Static and dynamical Insights into and 
noise in SQUIDs Optimal New embedding intuitions bo 
parameter setting techniques quantum heuristics 
Error suppression 


techniques Annealing theory of \ Future Performance 
embedded problems architectural estimators 
design elements 


Phase transitions in 


application problems 


Machine 
Learning and 
Artificial 
Design of new Intelligence 

application- 


focused QA Graph-based fault- 
architectures detection problems 


APPLICATION PROBLEMS 


QA solvers for 
complex planning and 
scheduling problems 
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D-Wave Syste 


m Hardware 
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¢ Collaboration with Google and 
USRA led to installation of 
system at NASA Ames in 2013 
¢ Started with 512-qubit Vesuvius 
processor (currently upgrading to 
2000-qubit Whistler) 
¢ 10 kg metal in vacuum at ~15 mK 
¢ Magnetic shielding to 1 nanoTesla 
¢ Protected from transient vibrations 
¢ Single annealing takes 20 us 
¢ Typical run of 10,000 anneals 
(incl. reset & readout takes ~4 sec) 
¢ Uses 12 kW of electrical power 


Magnetic Flux 


es. | 


Superconducting 
Loop 


Focused on solving discrete optimization problems using quantum annealing 7 
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D-Wave System Capability 


The system solves only one binary optimization problem: 


Given { h; SJ ij }, tate { Ss, = +1 } 
that minimizes 
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D-Wave 2X D-Wave 20000 


512 (8x8x8) qubit “Vesuvius” 
processor 


509 qubits working — 95% yield 
1472 J programmable couplers 


20 mK max operating 
temperature (18 mK nominal) 


5% and 3.5% precision level for 
hand J 


20 us annealing time 
12 ms programming time 


6 graph connectivity per qubit 


1152 (8x12x12) qubit 
“Washington” processor 


1097 qubits working — 95% yield 
3360 J programmable couplers 


15 mK max operating 
temperature (13 mK nominal) 


3.5% and 2% precision level for 
hand J 


5 us annealing time (4X better) 
12 ms programming time 


6 graph connectivity per qubit 


2048 (8x16x16) qubit “Whistler” 
processor 


2038 qubits working — 97% yield 
6016 J programmable couplers 


15 mK max operating temperature 
(nominal to be measured) 


To be measured 


5 us annealing time 
9 ms programming time (25% better) 
New: anneal offset, pause, quench 


6 graph connectivity per qubit 
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Programming the D-Wave System 


Map the target 
combinatorial optimization 
problem into QUBO 


No general algorithms but smart 
mathematical tricks (penalty 
functions, locality reduction, etc.) 


iin VijFme F BS O 


Bia (39; 7 22,9; = 22, a Z;Z;) 


DT Misi t Dogg Jig 8i; 


Mapping not needed for 
random spin-glass models 


Embed the QUBO coupling 
matrix in the hardware graph 
of interacting qubits 
D-Wave qubit hardware connectivity 


is a Chimera graph, so embedding 
methods mostly based on heuristics 


Vee AN 
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Embedding not needed for 
native Chimera problems 


Run the problem 
several times and 
collect statistics 


Use symmetries, 
permutations, and error 
correction to eliminate the 
systemic hardware errors 
and check the solutions 


Probability 


Performance can be 
improved dramatically with 
smart pre-/post-processing 
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Binary variable: 


Graph Coloring Problem: 
Assign one of k colors to each 1 vertex v with color c 
vertex so that no two vertices a 
sharing an edge have the same 


color 
et 


Q vertex v not with color c 


Violation of requirements encoded as cost: 


e (1) unique assignment: Each vertex v must be 


assigned exactly one color: 


Costing cases 


O a mae) _— >” Lye — 1)7 & S- Lye = 1 


cEC cEC 


(1) No color or Multi-colored 


e (2) Connected vertices cannot use the same color 


(exclude) 


(2) Same color for connected vertices v,v',c 
Final QUBO form: 


= Dee + S- pe teas 


v,v'ECE Cc 


'H=0 corresponds to a valid coloring 1 
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Embedding the QUBO 


Embed a triangle onto a bipartite graph 
original QUBO hardware connectivity QUBO embedded 


(2 oem 20) 

GRE 
Ho = J2%1L2q + Jo3%o%3 + J13%1 23 Ay = Jy2%1q%q + Jo3%2%3 + J13%1H%3 + JFerroLiaL1p 
Strong, but not too strong, ferromagnetic coupling between physical qubits x;, and x4, 


encourages them to take the same value, thus acting as a single logical qubit x, 


Embedding a realistic problem instance: 
Ribicae enenainiyie ds ree: Pals (Ho and H1 have the same ground state but the 
: ae st Aa. energy landscape of the search space differs 


Current research investigation: How best 


to set the magnitude of these “strong” 
couplings to maximize probability of success 
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Current NASA Research in Applications 


i a ¢ General Planning Problems (e.g., navigation, 


scheduling, asset allocation) can be solved on a 


Initial State poncanocnan +g 
quantum annealer 


¢ Developed a quantum solver for Job Shop 
Scheduling that pre-characterizes instance 
ensembles to design optimal embedding and run 
strategy — tested at small scale (6x6) but 
potentially could solve intractable problems 
i (15x15) with 10x more qubits 


¢ Analyzed simple graphs of Electrical Power 
Networks to find the most probable cause of 
multiple faults — easy and scalable QUBO 


Circuit 
Breakers 


GADIOD ADO DO AOOOA Aaa 


Pa \/ @ . . 
1000100010001 11 1 Observations si \ mapping, but good parameter setting (e.g., 
; ° gauge selection) key to finding optimal solution — 
Graph Isomorphism now exploring digital circuit Fault Diagnostics 


and V&V 


Subgraph Matching Problems are common in 
applications of interest to the intelligence 
community — similarly, finding Longest Matching 
Sequences important in genomics and 
bioinformatics 
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Current NASA Research in Quantum Physics 


Calibration of Quantum Annealers ¢ Developed technique to determine and correct 


ni 0} 4 residual persistent biases in the programmable 
S140 h — h + be }  HEra0 1 
g" | prog — “spec T Wiis |g” parameters of quantum annealers (h and J) — 
45100 | ae correction significantly improves performance 
3. so" and reliability (reduction in variability) 
40} € 40 1 4 1 4 
3° 3° - First realistic noise analyses show how low- 
-805-0.04-0.03-0.02-0.01 0 0.01 0.02 0.03 0.04 0.05 605 0.04 -0.03 0.02 0.01 O 0.01 0.02 0.03 0.04 0.05 frequency noise dramatically affects the 
h biases (before) correction h biases after correction performance of quantum annealers — results 


Effect of Noise on Quantum Annealing being used to design hardware improvements 


. f Limited hardware connectivity makes embedding 
77S challenging — good runtime parameters 
determined by considering the nature and 


> 4) dynamics of chains — quick scans can be used 
L———tyy __\/ - to predict performance of extensive scans 
Optimal Embedding & Parameter Setting ° Small instances of hard problems at phase 
Pal = 4) 25 transitions in combinatorial optimization are 
if ; mK 20 intractable — they can be designed by looking at 
\ RE aed 8, solvability phase transitions 
- “ ° ¢ Predict tractability of application problems by 
Sie 46, i studying the scaling of energy gaps and density 


a A of bottlenecks in spin glass phase 14 


2 4 6 8 
Ferromagnetic coupling within logical qubits J, 
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Emerging Quantum Hardware 


¢ What should we do with the emerging and 
exciting, but limited, quantum computational 
devices? 


— Still too small to be useful for solving practical 
problems 


¢ Couple of possibilities: 


— Quantum supremacy 
— Develop intuitions for quantum heuristics 
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Quantum Heuristics 


Known quantum 
algorithms for a 
few dozen 
problems witha 
provable 
quantum 
advantage 


Everything Else! 


(incl. most practical problems) 


Even for classical computations 
— Provable bounds hard to obtain 


— Robust analysis is just too difficult 


Best classical algorithm not 
known for most problems 


Ongoing development of classical 
heuristic approaches 

— Analyzed empirically: run and see 
Emerging quantum hardware 
enables evaluation of heuristic 
quantum algorithms 


Handful of 
proven 
limitations on 
quantum 
computing 
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Designing and Vetting Quantum Heuristics 

1. Generate suggestions for good Pool of quantum properties 

quantum heuristics, e.g., 

— Hypotheses for computational 
utilization of quantum effects 


— Algorithmic structures that 


encompass quantum algorithms Quantum tunneling 
with provable benefits 
—- Compelling arguments for Quantum sampling 
advantage in larger-scale 
application problems; robustness 
. Design experiments running N tati t t 
tailored problems on available easels bale Ud he 
hardware to confirm or deny Quantum discord 
hypotheses 
. Analyze and compare with classical Quantum adiabatic theorem 


algorithms, incl. those inspired by 
these quantum intuitions Quantum contextuality 


National Aeronautics and . ‘ 
NASA Space Administraion Wes / te ’ ’ cc Cc 
; fF j aX 2 


Discovery Innovations Solutions 


Case Study: Quantum Tunneling & Annealing 


1. Intuition for quantum annealing 


« K. Kechedzhi, V. Smelyanskiy, Open System 
Quantum Annealing in Mean Field Models with 
Exponential Degeneracy, PRX (2016) 

¢ S.Knysh, Computational Bottlenecks of 
Quantum Annealing, arXiv:1506.08608 

¢ D. Venturelli, S. Mandra, S. Knysh, B. O'Gorman, R. 
Biswas, V. Smelyanskiy, Quantum Optimization of 
Fully-Connected Spin Glasses, PRX (2015) 

¢ H. Nishimori, J. Tsuda, S. Knysh, Comparative 
Study of the Performance of Quantum Annealing 
and Simulated Annealing, PRE (2014) 

¢ V.Smelyanskiy, D. Venturelli, A. Perdomo-Ortiz, S. 
Knysh, M. Dykman, Quantum Annealing via 
Environment-Mediated Quantum Diffusion, 
arXiv:1511.02581 


2. Tailored problems for quantum 
tunneling 
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Number of qubits 


« V.Denchev, S. Boixo, S. Isakov, N. Ding, R. Babbush, V. Smelyanskiy, J. Martinis, H. 
Neven, What is the Computational Value of Finite Range Tunneling?, PRX (2016) 


¢ §S. Boixo, V. Smelyanskiy, A. Shabani, S. lsakov, M. Dykman, V. Denchev, M. Amin, A. 


Smimov, M. Mohseni, H. Neven, Computational Multi-qubit Tunneling in 
Programmable Quantum Annealers, Nat. Comm. (2016) 


3a. Comparison, incl. new techniques 


1014 


Annealing time (,1s) 
ok 
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Number of qubits 


¢ §.Mandra, Z. Zhu, W. Wang, A. Perdomo-Ortiz, H. Katzgraber, Strengths and 
Weaknesses of Weak-Strong Cluster Problems: A Detailed Overview of State- 
of-the-Art Classical Heuristics vs. Quantum Approaches, PRA (2016) 


bias = 0.1 


e@-@ N. gamma = 0.3 


3b. And analysis fo ee 


er aoowe = & A. gamma =0.4 


e@-© N. gamma = 0.5 


Instanton method: a = Agena 08 
exponential scaling  *” 
of escape rate in 
QMC equals “yseneegesesesegerees 
tunneling rate in QA ae. 


ae Oo  -- 


« Z. Jiang, V. Smelyanskiy, S. lsakov, S. Boixo, G. Mazzola, M. Troyer, H. Neven, 
Scaling Analysis and Instantons for Thermally-Assisted Tunneling and 
Quantum Monte Carlo Simulations, arXiv:1603.01293 (2016) 
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Quantum-—Classical Hybrid Approaches 


Exploits complementary properties of quantum and classical solvers: 
¢ Quantum annealing provides heuristic 

¢ Classical processing ensures complete search 

¢ Enlarges application domain of quantum annealers 


QA-guided tree search QA results exploited to 
guide the tree search 


Application domains tested 


Global Search Tree 
Manager (Classical 
Computer) 


n 
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Quantum Annealer Battery Constraint 
(D-Wave 2X) Checker (Classical 
Computer) 


Graph coloring Mars Lander 
activity scheduling 


search cost 


Quantum annealer samples the 
search space of a relaxed 
version of the original problem 


Airport runway 


weight of QA-guide scheduling 


On-going study of hybrid methods 
Incorporating more advanced quantum-classical interaction 
using techniques such as Logic Benders Decomposition, 
column generation, and large neighborhood search 


¢ T. Tran, M. Do, E. Rieffel, J. Frank, Z. Wang, B. O'Gorman, 
D. Venturelli, J. Beck, A Hybrid Quantum-Classical 
Approach to Solving Scheduling Problems, SOCS’'16 

« T. Tran, Z. Wang, M. Do, E. Rieffel, J. Frank, B. O'Gorman, 
D. Venturelli, J. Beck, Explorations of Quantum- 
Classical Approaches to Scheduling a Mars Lander 
Activity Problem, Workshops AAAI'16 
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Universities Space Research Association (USRA) 


Academia and Industry Engagement Program 


A program to enable a diversity of research in quantum computing, and 
develop the next-generation workforce with expertise in quantum computing 


Free Compute Time 


Available for qualified 
research projects from 
universities and industry. 
Projects selected through a 
competitive process 


Ahad OM /AWAYAN UES) r- MoxeL0/Leler-lalieranyaniey) 


fold CJale) ole 
Seminars, Training 


University and industry 
researchers invited to 
participate in workshops and 
other educational 
(oye) oXoyg ESS 


Visiting Scientist 
Program 


Universities and industry 
can sponsor a visiting 
scientist to work at NASA 
Ames with QuAIL team 
members 


Mo) i aimed ne) eles-y-1 [> 


University and industry 
scientists invited to 
collaborate on proposals to 
sponsored research 
programs 
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Conclusions 


¢ Understanding and harnessing the fundamental power of quantum 


computing is a formidable challenge that requires: 
— New insights in physics and mathematics 


- Innovations in computer and computational science 
— Breakthroughs in engineering design to produce robust, reliable, scalable technologies 


¢ NASA QUAIL team has successfully demonstrated that discrete 
optimization problems can be run on quantum annealers 
— Effectively using such systems needs judicious mapping, embedding, execution strategies 
¢ Exciting decade in quantum computing ahead of us 
- Compilation and performance capabilities of today’s annealers are improving rapidly 
— New and better quantum algorithms, particularly quantum heuristics, are emerging 
—- Small-scale universal quantum computers are becoming availableg 


ENIAC (1946), the first “general-purpose” computer 


The task of taking a problem and mapping it onto the machine was complex, 
and usually took weeks. After the program was figured out on paper, the 
process of getting the program "into" ENIAC by manipulating its switches 
and cables took additional days. This was followed by a period of verification 


and debugging [...] (source: http://en.wikipedia.org/wiki/ENIAC) 


